Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Change subjectId List to Iterable #257

Merged
merged 10 commits into from
Mar 1, 2023
Merged

Change subjectId List to Iterable #257

merged 10 commits into from
Mar 1, 2023

Conversation

Capt-Mac
Copy link
Contributor

In order to avoid memory issues with large datasets, it was required to alter subjectId list to an iterable. This required updating all references of List to Iterable for measure evaluation. Also altered how threaded evaluation works, now instead of sizing the list and breaking it in chunks, it will create batches as they iterate through the dataset. Outcome should be improved performance

@mdnazmulkarim
Copy link
Contributor

Showing some conflicts, needs to be resolved

@JPercival JPercival merged commit 5444883 into master Mar 1, 2023
@JPercival JPercival deleted the subjectid-iterable branch March 1, 2023 22:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants